Regression Benchmarking Environment

نویسنده

  • Tomáš Kalibera
چکیده

Regression benchmarking as a part of regression testing is an application of benchmarking that aims at an automatic detection of performance regressions during application development. While the automation is a crucial requirement for regression benchmarking, it is hard to meet this requirement with contemporary benchmarks that are usually not fully automated. The paper gives an analysis of the requirements of a general benchmarking environment for automation of middleware benchmarks and proposes its architecture, with the regression benchmarking as its application in mind.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Generic Environment for Full Automation of Benchmarking

Regression testing is an important part of software quality assurance. We work to extend regression testing to include regression benchmarking, which applies benchmarking to detect regressions in performance. Given the specific requirements of regression benchmarking, many contemporary benchmarks are not directly usable in regression benchmarking. To overcome this, we present a case for designi...

متن کامل

An Efficiency Measurement and Benchmarking Model Based on Tobit Regression, GANN-DEA and PSOGA

The purpose of this study is designing a model based on Tobit regression, DEA, Artificial Neural Network, Genetic Algorithm and Particle Swarm Optimization to evaluate the efficiency and also benchmarking the efficient and inefficient units. This model has three stages, and it uses the data envelopment analysis combined model with neural network, optimized by genetic algorithm, to evaluate the ...

متن کامل

Mono Regression Benchmarking

Regression benchmarking is a methodology for detecting performance changes in software by periodic benchmarking. Detecting performance regressions in particular helps to improve software quality, similarly as regression testing, which however focuses only on software functionality. To achieve an acceptable level of false alarms, regression benchmarking requires a statistically sound planning an...

متن کامل

RTJBench: A Real-Time Java Benchmarking Framework

The paper gives an overview of RTJBench, a framework designed to assist in the task of benchmarking programs written in the Real-Time Specification for Java, but with potentially more general applicability. RTJBench extends the JUnit framework for unit testing of Java applications with tools for real-time environment configuration, simple data processing and configurable graphical presentation ...

متن کامل

Using the fuzzy linear regression method to benchmark the energy efficiency of commercial buildings

Benchmarking systems from a sample of reference buildings need to be developed to conduct benchmarking processes for the energy efficiency of commercial buildings. However, not all benchmarking systems can be adopted by public users (i.e., other non-reference building owners) because of the different methods in developing such systems. An approach for benchmarking the energy efficiency of comme...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2004